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ENCODING OF WAVELET TRANSFORMED ERROR DATA 

Cross-Reference to Related Application 
This is a continuation-in-part of patent application serial number 09/390,255 filed 
on September 3 5 1999. 

5 Background 

The invention generally relates to encoding of wavelet data, such as zerotree 
encoding of wavelet transformed error data, for example. 

Data compression typically removes redundant information from a set of data to 
produce another set of data having a smaller size. This smaller size may be beneficial, 

10 for example, for purposes of transmitting the data over a bus or network. 

For example, the pixel intensities of an image may be indicated by a set of 
coefficients, and these coefficients may be represented by digital image data. For 
purposes of compressing the image data, the data may be transformed to reveal redundant 
information, i.e., redundant information may be removed via data compression. For 

15 example, the image data may be transformed pursuant to a wavelet transformation, a 

transformation that effectively decomposes the image into spatially filtered images called 
frequency subbands. In this manner, the subbands may reveal a significant amount of 
redundant information that may be removed by compression techniques. 

Referring to Figure 1, as an example, image data that indicates pixel intensities of 

20 an image 12 may undergo wavelet transformations to decompose the image 12 into 
subbands. Due to the nature of the transformations, the subbands appear in different 
decomposition levels (levels 14, 16 and 18, as examples). In this manner, to decompose 
the original image 12 into subbands 14a, 14b, 14c and 14d of the first decomposition 
level 14, the one dimensional Discrete Wavelet Transform (DWT) is applied row-wise 

25 and then column-wise. In one dimensional DWT, the signal (say a row- wise) is first low- 
pass filtered and sub-sampled by dropping the alternate filtered output to produce the 
low-frequency subband (L) which is half the size of the original signal. Then the same 
signal is high-pass filtered and similarly sub-sampled to produce the high-frequency 
subband (H) which is half the size of the original signal. When the same one dimensional 
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operation is applied column- wise on the L subband, it produces two subbands LL and 
LH. Similarly, applying the same one dimensional operation column- wise on the H 
subband, it produces two subbands HL and HH subbands. 

As a result after two-dimensional Discrete Wavelet Transform, the original image 
5 12 is decomposed into four subbands: the LL subband 14a, the LH subband 14b, HL 
subband 14c and HH subband 14d. Sizes of the row and column of each of these 
subbands is half the sizes of the row and column of the original images due to the sub- 
sampling operation. The values of these subbands are called the wavelet coefficients and 
hence the subbands may be represented by an associated matrix of wavelet coefficients. 

10 The LL subband 14a indicates low frequency information in both the horizontal 

and vertical directions of the image 12 and typically represents a considerable amount of 
information present in the image 12 because it is nothing but the sub-sampled version of 
the original image 12. The LH subband 14b indicates low frequency information in the 
horizontal direction and high frequency information in the vertical direction, i.e., 

15 horizontal edge information. The HL subband 14c indicates high frequency information 
in the horizontal direction and low frequency information in the vertical direction, i.e., 
vertical edge information. The HH subband 14b indicates high frequency information in 
the horizontal direction and high frequency information in the vertical direction, i.e., 
diagonal edge information. 

20 Since LL subband 14a is nothing but the sub-sampled version of the original 

image, it maintains the spatial characteristics of the original image. As a result, the same 
DWT decomposition can be further applied to produce four subbands that have half the 
resolution of the LL subband 14a in both the vertical and horizontal directions: the LL 
subband 16a, LH subband 16b, HL subband 16c and HH subband 16d. Hence the LL 

25 subband 16a is again the sub-sampled version of the LL subband 14a. Hence LL subband 
16a can be further decomposed to four subbands that have half of its resolution in both 
horizontal and vertical directions: LL subband 18a, LH subband 18b, HL subband 18c 
and HH subband 18d. 

The subbands of the lower decomposition levels indicate the information that is 

30 present in the original image 12 in finer detail (i.e., the subbands indicate a higher 
resolution version of the image 12) than the corresponding subbands of the higher 
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decomposition levels. For example, the HH subband 18d (the parent of the HH subband 
16d) indicates the information that is present in the original image 12 in coarser detail 
than the HH subband 16d (the child of the HH subband 18d), and the HH subband image 
14d (another descendant of the HH subband 18d) indicates the information that is present 
5 in the original image 12 in finer detail than the HH 16d and 18d subbands. In this 
manner, a pixel location 24 of the HH subband image 18d corresponds to four pixel 
locations 22 of the HH subband 16d and sixteen pixel locations 20 of the HH subband 
14d. 

Due to the relationship of the pixel locations between the parent subband and its 

10 descendants, a technique called zerotree coding may be used to identify wavelet 

coefficients called zerotree roots. In general, a zerotree root is a wavelet coefficient that 
satisfies two properties: the coefficient has an insignificant intensity, and all of the 
descendants of the coefficient have insignificant intensities with respect to a certain 
threshold. Thus, due to this relationship, a chain of insignificant coefficients may be 

15 indicated by a single code, a technique that compresses the size of the data that indicates 
the original image. As an example, if the wavelet coefficient for the location 24 is a 
zerotree root, then the wavelet coefficients for the locations 20, 22 and 24 are 
insignificant and may be denoted by a single code. 

The coding of each decomposition level typically includes two passes: a dominant 

20 pass to determine a dominant list of wavelet coefficients that have not been evaluated for 
significance and a subordinate pass to determine a subordinate list of wavelet coefficients 
that have been determined to be significant. During the subordinate pass, a threshold 
may be calculated for each subband and used to evaluate whether coefficients of the 
subband are insignificant or significant. Unfortunately, due to the computational 

25 complexity, the above-described compression technique may be too slow for some 
applications, such as an interactive video compression application, for example. 

Thus, there is a continuing need for an arrangement that addresses one or more of 
the above-stated problems. 

Brief Description of the Drawings 
30 Figure 1 is an illustration of the hierarchical order of subbands produced by 

wavelet transformations; 
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Figure 2 is a schematic diagram of a computer system according to an 
embodiment of the invention; 

Figure 3 is an illustration of a scanning path to determine zerotree roots according 
to an embodiment of the invention; 
5 Figure 4 is an illustration of the organization of a wavelet coefficient matrix 

according to an embodiment of the invention; 

Figure 5 is an illustration of a scanning path for a wavelet coefficient matrix; 

Figure 6 is an illustration of a path that is traversed to locate zerotree roots; 

Figure 7 is a flow chart illustrating the execution of a program to encode wavelet 
10 coefficients according to an embodiment of the invention; 

Figure 8 is a block depiction of a codec in accordance with one embodiment of 
the present invention; 

Figure 9 is a block diagram of a sequence decoder in accordance with one 
embodiment of the present invention; 
15 Figure 10 depicts a scanning pattern in one embodiment of the present invention; 

Figure 1 1 is a flow chart in accordance with one embodiment of the present 
invention; 

Figure 12 is a diagram showing the scanning pattern for embedded coding in 
accordance with one embodiment of the present invention; and 
20 Figure 13 is a diagram showing the parent/child relationship between blocks in 

accordance with one embodiment of the present invention. 

Detailed Description 
Referring to Figure 2, an embodiment 1 19 of a compression program, in 
accordance with one embodiment of the invention, may enable a processor 112 to encode 

25 wavelet coefficients in a bit-wise fashion in a technique which may be called modified 
embedded zerotree (MEZT) coding. In this manner, instead of classifying the wavelet 
coefficients (as zerotree roots or isolated zeros, as examples), the processor 112 may 
produce codes to classify the bits of the wavelet coefficients. For example, in some 
embodiments, the processor 112 may classify a particular bit as being either a zerotree 

30 root, an isolated zero, a positive node or a negative node. Unlike conventional zerotree 
coding schemes, thresholds are not computed to identify insignificant values, as the "0" 
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bit is treated as being insignificant and the and "1" bits are treated as being 
significant. 

In this manner, the processor 1 12 may generate one of the following codes to 
classify a particular bit: a S T" code to indicate a positive node if the bit indicates a "1"; 
5 an "N" code to indicate a negative node if the bit indicates a "-1"; an "R" code to indicate 
that a "0" bit is a zerotree root; and an "IZ" code to indicate that a "0" bit is an isolated 
zero. In some embodiments, a particular bit is classified as a negative node only if the 
bit is the most significant nonzero bit and the bit indicates a "-1." For example, for a 
coefficient of "-3" that is represented by the three bits "-01 1," the processor 1 12 

10 generates an N code to represent the middle bit. However, for this example, the 
processor 112 generates a P code to represent the least significant bit. 

For purposes of providing the wavelet coefficients, the processor 112 may, via 
wavelet transformations, decompose coefficients that represent pixel intensities of an 
original image. These wavelet coefficients, in turn, form subbands that are located in 

15 multiple decomposition levels. To classify the bits, the processor 1 12, in some 

embodiments, may execute the program 1 19 to process the bits based on their associated 
bit position, or order. In this manner, the bits of each bit order form a hierarchical tree 
that the processor 1 12 may traverse to classify each of the bits of the tree as being either a 
zerotree root, an isolated zero, a negative node or a positive node. Thus, as an example, 

20 the most significant bits of the wavelet coefficients(this bit may also be zero) are 

associated with one hierarchical tree (and one bit order), and the next most significant 
bits are associated with another hierarchical tree (and another bit order). 

For example, if the absolute maximum wavelet coefficient is represented by three 
bits (as an example), then all of the wavelet coefficients may be represented by three bits. 

25 Therefore, for this example, three hierarchical trees are formed. In this manner, the 

processor 112 produces a code for each bit based on its indicated value (i.e., "-1," "0," or 
"1") and possibly (if the bit indicates a "0") its position in the associated hierarchical tree. 

In some embodiments, the processor 112 indicates the P, N, IZ and R codes via a 
bit stream that progressively indicates a more refined (i.e., a higher resolution) version of 

30 the original image over time. For example, the processor 112 may use the bits "00" to 
indicate the *T" code, the bits "01" to indicate the "N" code, the bits "10" to indicate the 
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<4 R" code and the bits "11" to indicate the IZ code. Other coding schemes are possible. 
The progressive nature of the bit stream is attributable to the order in which the processor 
1 12 processes the bit orders. For example, in some embodiments, the processor 112 may 
process the bit orders in a most significant first fashion. Therefore, the processor 1 12 
5 may initially produce code for all the bits that have the highest bit order, then produce 
code for all of the bits that have the next highest bit order, etc. As a result of this 
progressing coding, the resultant bit stream may initially indicate a coarser version of the 
original image. However, more refinements to the image are indicated by the bit stream 
over time, as the processor 112 produces the codes for the bits having the lower bit 

10 orders. Thus, in some embodiments, the resolution of the image that is indicated by the 
bit stream improves over time, a feature that may be desirable for bandwidth-limited 
systems. As a result, a decrease in resolution of the reconstructed image may be traded 
for a decrease in communication bandwidth. 

Referring to Figure 3, in some embodiments, the processor 1 12 process the bits of 

1 5 each order in a predefined sequence. For example, for a particular bit order, the 

processor 112 may begin with the highest decomposition level and produce codes for the 
bits of the highest decomposition level before proceeding to produce codes for the bits of 
the next highest decomposition level The processor 112 produces code(s) for the bit(s) 
of the LL subband and, then for each decomposition level, produces code(s) for the bit(s) 

20 of the LH subband, subsequently, produces code(s) for the bit(s) of the HL subband and 
lastly, produces code(s) the bit(s) of the HH subband. 

As an example, the wavelet coefficients produced by a two level decomposition 
may be arranged in a matrix 40 that is depicted in Figure 4. In this manner, the matrix 40 
may be viewed as being subdivided into four quadrants 30a, 30b, 30c and 30d. The 

25 upper right 30b, lower left 30c and lower right 30d quadrants includes the coefficients for 
the LH, HL and HH subband images, respectively, of the first decomposition level. The 
coefficients for the LL, LH, HL and HH subband images of the second decomposition 
level are located in the upper left 32a, upper right 32b, lower left 32c and lower right 32d 
quadrants of the upper left quadrant 30a. The coefficients produced by further 

30 decomposition may be arranged in a similar manner. For example, for a third level of 
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decomposition, the upper left quadrant 32a includes the wavelet coefficients of the LL, 
LH, HL and HH subbands of the third decomposition level 

If the coefficient matrix that indicates the pixel intensities for the original image is 
a 4X4 matrix, then the matrix 40 may be of the form that is depicted in Figure 5, In this 
5 manner, the LL, LH, HL and HH subband images of the second decomposition level each 
have one coefficient, represented by "A" (for the LL subband image), "B" (for the LH 
subband image), "C" (for the HL subband image) and "D" (for the HH subband image), 
respectively. As depicted in Figure 5, for the first decomposition level, the coefficients 
for the LH, HL and HH subband images are represented by the following respective 
10 matrices: 



"E, E 2 " 




"F, 


F 2 " 




G, G 2 


E, E 4 _ 




_ F 3 


F 4 . 


5 


G 3 G 4 _ 



It is noted that each coefficient of the second decomposition level (except A), is 
associated with at least four coefficients of the first decomposition level, i.e., each 
coefficient of the first decomposition level has at least four descendant coefficients in the 

1 5 second decomposition level Therefore, each bit in the first decomposition level has at 
least four descendent coefficients in the second decomposition level 

For each bit order, the processor 112 may process the bits in the scanning 
sequence described above. If a particular bit indicates a "1" or a "-1," then the processor 
1 12 generates the P or N code and proceeds to process the next bit in the scanning 

20 sequence. However, if a particular bit indicates a "0," then the processor 112 may trace 
the bit through its descendants to determine if the bit is an isolated zero or a zerotree root. 
The coefficients in the LL subband are simply entropy encoded. 

As an example, to produce the code for the least significant bit (called D(l)) of 
the D coefficient (located in the HH subband of the second decomposition level), the 

25 processor 1 12 determines whether the D(l) bit indicates a "0.*' If so, the processor 1 12 
evaluates the descendant bits Gl(l), G2(l), G3(l) and G4(l) of the subband HH of the 
first decomposition level in search of a "1" or as indicated in Figure 6. If one of 
these bits indicates a "1" or "-1 then the D(l) bit is an isolated zero. Otherwise the D(l) 
bit is a zerotree root. 



7 



As a numeric example, a 4X4 coefficient matrix that indicates pixel intensities for 
an image may undergo a two level decomposition to form the following matrix: 

"4 112" 
-2 0 0 1 
0 3 0 0 
0 1 0 0 

Because the maximum absolute value is "4," three bits may be used to represent the 
5 coefficients, as depicted in the following matrix: 



100 


001 


001 


010 


-010 


000 


000 


001 


000 


011 


000 


000 


000 


001 


000 


000 



Therefore, the processor 112 begins the encoding by generating codes for the third order 
bits (i.e., the most significant bits, which may be zero also) of the coefficients. More 
particularly, to generate the codes for the third order bits, the processor 1 12 follows the 

10 path 28 (see Figure 5) and produces the appropriate code for the third bit of each 

coefficient along the path 28. If a particular bit indicates a "0," then the processor 1 12 
evaluates the descendents of the bit to find isolated zeros and zero roots. The coding of 
the third order bits by the processor 1 12 produces the following codes (listed in the order 
of production): P,R,R,R. Subsequently, the processor 112 produces the codes for the 

1 5 second order bits (listed in order of production): IZ,IZ,N,R,IZ,P ? IZ 5 IZ,IZ,P,IZ,IZ. 
Lastly, the processor 1 12 produces the codes for the first order bits (listed in order of 
production): IZ,P,IZ,R,P,IZ,IZ ? P,IZ,P,IZ,P. As described above, the processor 1 12 may 
indicate the codes via a two bit coding scheme and transmit the codes as produced via a 
bit stream. 

20 As an example, another processor 200 (see Figure 2) may use the bit stream to 

reconstruct the coefficient matrix that indicates the pixel in intensities of the original 
image in the following manner. Before the decoding begins, the processor 200 first 
receives an indication from the processor 112 that three levels of coding (i.e., one level 
for each bit order) have been used. After obtaining this information, the processor 200 
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may reconstruct the original coefficient matrix using the codes in the order that the codes 
are produced. More particularly, the processor 200 may use the codes produced by the 
coding of the bits of the third bit order (i.e., the first level of coding) to produce the 
following matrix: 
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100 


000 


000 


000 


000 


000 


000 


000 


000 


000 


000 


000 


000 


000 


000 


000 



The processor 200 may use this matrix to reconstruct a coarse version (i.e., a lower 
resolution version) of the original image. However, if a more refined version is desired, 
the processor 200 may use the codes that are produced by the coding of the second bit 
order (i.e., the second level of coding) to produce the following matrix: 
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100 


000 


000 


000 


-010 


000 


000 


000 


000 


010 


000 


000 


000 


000 


000 


000 



Finally, if the processor 200 uses the codes that are produced by the coding of the bits of 
the first order (i.e., the third level of coding), the processor 200 produces the original 
matrix of decomposed wavelet coefficients. 

Referring to Figure 7, to summarize, the compression program 119, when 

1 5 executed by the processor 112 may cause the processor 1 12 to perform the following 
procedure to produce the above-described coding. First, the processor 1 12 may express 
(block 72) a matrix of decomposed coefficients in a signed binary representation. Next, 
the processor 112 may determine (block 74) the number of digits that are needed to 
represent the absolute value of the maximum wavelet coefficient. This processor 112 

20 uses a variable (called n) that indicates the current bit order being processed by the 

processor 112. In this manner, the processor 112 uses a software loop to process the bits, 
one bit order at a time. To accomplish this, the processor 112 produces codes (block 76) 
for the bits of the current bit order the using the techniques described above. 
Subsequently, the processor 1 12 determines (diamond 78) whether the rate of transmitted 
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bits may exceed a predetermined bit rate. If so, the processor 1 12 terminates the coding 
for the current image to comply with the predetermined bit rate. Otherwise, the processor 
1 12 determines (diamond 80) if all bit orders have been processed, i.e., the processor 112 
determines if n equals "1 If not, the processor 1 12 decrements (block 75) the order that 
5 is indicated by the n variable by one and proceeds to block 76 to traverse the loop another 
time to produce codes for the bits of another bit order. Otherwise, the coding is 
complete. 

Referring back to Figure 2, in some embodiments, the processor 1 12 may be part 
of a computer system 100. The computer system 100 may include a bridge, or memory 

1 0 hub 116, and the processor 112 and the memory hub 116 may be coupled to a host bus 
1 14. The memory hub 116 may provide interfaces to couple the host bus 1 14, a memory 
bus 129 and an Accelerated Graphics Port (AGP) bus 1 1 1 together. The AGP is 
described in detail in the Accelerated Graphics Port Interface Specification, Revision 1.0, 
published on July 3 1 , 1996, by Intel Corporation of Santa Clara, California. A system 

1 5 memory 1 1 8 may be coupled to the memory bus 129 and store the compression program 

119. As described above, the compression program 119, when executed by the processor 
112, may cause the processor 1 12 to provide wavelet coefficients that indicate an image 
and represent each wavelet coefficient as a collection of ordered bits. The processor 112 
codes the bits of each order to indicate zerotree roots that are associated with the order. 

20 Among other features of the computer system 100, a display controller 1 13 (that 

controls the display 114) may be coupled to the AGP bus 1 1 . A hub communication link 
1 15 may couple the memory hub 1 16 to another bridge circuit, or input/output (I/O) hub 

120. In some embodiments, the I/O hub 120 includes interfaces to an I/O expansion bus 
125 and a Peripheral Component Interconnect (PCI) bus 121. The PCI Specification is 

25 available from The PCI Special Interest Group, Portland, Oregon 972 14. 

A modem 140 may be coupled to the PCI bus 121 to a telephone line 142. In this 
manner, the modem 140 may provide an interface that permits the bit stream that is 
produced by the processor 1 12 to be communicated to the processor 200. The I/O hub 
120 may also include interfaces to a hard disk drive 132 and a CD-ROM drive 133, as 

30 examples. An I/O controller 117 may be coupled to the I/O expansion bus 125 and 
receive input data from a keyboard 124 and a mouse 126, as examples. The I/O 
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controller 1 17 may also control operations of a floppy disk drive 122. Copies of the 
program 119 maybe stored on, as examples, the hard disk drive 132, a diskette or a CD- 
ROM, as just a few examples. 

In the context of this application, the phrase "computer system" may generally 
5 refer to a processor-based system and may include (but is not limited to) a graphics 
system, a desktop computer or a mobile computer (a laptop computer, for example), as 
just a few examples. The term "processor" may refer to, as examples, at least one 
microcontroller, X86 microprocessor, Advanced RISC Machine (ARM) microprocessor, 
or Pentium-based microprocessor. The examples given above are not intended to be 

10 limiting, but rather, other types of computer systems and other types of processors may 
be included in embodiments of the invention. 

Unlike still image compression, video sequence codecs need to be 
computationally efficient. In case of real time interactive applications, a codec may need 
to process video frames at a rate of 30 frames/second or higher. 

15 The codec 800 input 802, shown in Figure 8, includes frames of the incoming 

video sequence. The frames are coded by the codec 800 as intra (I), predicted (P) or 
skipped (S) frames. The I frame, which is sent at regular intervals starting from the first 
frame, contains the result of arithmetic coding (AC) 824 on the modified embedded 
zerotree (MEZT) coded 826 discrete wavelet transformed (DWT) image 828, as 

20 described previously herein. One suitable arithmetic coding technique is described in 
LH. Witten et al., "Arithmetic Coding for Data Compression", Communications of the 
ACM, Vol. 30, No. 6, June 1987. 

An error image, error frame or error data is the difference between two frames of 
image data. For the first frame, which is an intra or I -frame, MEZT may be applied as 

25 indicated at 826. The next frame is the predicted or P-frame, that is not directly encoded. 
Instead, the difference from the first or I frame is determined at 808 and that difference is 
encoded at 812. 

The reconstructed predicted frame is the result of encoding error frames using 
reverse embedded zerotree coded error frames REZT 812 followed by inverse REZT 
30 (IREZT) 840. REZT will be explained later. A reconstructed image 830 is then 

developed from the motion estimation 804 to develop the skipped or S frame 832 and the 
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predicted or P frame 806. The reconstructed frame 830 goes to the inverting input of 
summer 808. The error compensation 816 is developed from the error frame from 
IREZT 840 and added to the S frame at 832 to get the P frame 806, 

The programmable switch 814 is used to select an I frame, P frame or S frame 
5 based on quality feedback. If the error determined by the IREZT 840 is very small there 
is no need to use that data and so the data is simply skipped or dropped and only the 
motion vector 804 is transmitted which is received from the block 830. When the error is 
high, data is compensated or added at 813 and the P frame is used. The block 842 
designates the selected frame as the previous frame for the motion estimation 804. 

10 Regular transmission of I frames ensures robustness of the codec 800 against any 

channel error and removal of accumulated reconstruction error. However, since frequent 
transmission of I frames may reduce the compression ratio (CR), an optimization may be 
used to maintain a high CR as well as robustness of the codec 800. For the remaining 
frames, motion estimation 804 with respect to the previous reconstructed frames 806 is 

15 done using multi-resolution motion estimation (MRME) technique. One suitable MRME 
technique is described in Ya-Qin Zhang et al. "Motion-Compensated Wavelet Transform 
Coding for Color Video Compression", IEEE Trans. On Circuits and Systems for Video 
Technology, Vol. 2, No. 3, pp. 285-296, September 1992. In cases where the quality of 
motion estimation leads to small prediction errors, high compression is achieved by 

20 dropping the corresponding error frames and transmitting only the motion vectors (such 
frames are denoted by S or skipped frames) 832. 

When the error accumulated by this process crosses a certain threshold as 
determined at 830, the codec 800 is partially refreshed by transmitting the stream 
generated by application of AC 812 on a REZT 812 error frame along with the motion 

25 vectors 832. Such frames, denoted by P, may be sent at an optimal frequency to maintain 
a high CR as well as a high peak signal to noise ratio (PSNR) of the reconstructed 
sequence. 

Thus, switching between I, P and S frames is controlled by the energy of the error 
frame. The performance of the codec 800 may be primarily dependent on the efficiency 
30 of REZT 810 and hence also on the correctness and efficiency of MRME 804. 



12 



Usually, the codec 800 sends a motion vector m from 804 and optionally an error 
value e from 808. For the P frame both the motion vector m and the error value e are 
sent. For an S frame, only the motion vector m is sent. 

The information generated by the processes described above is packed at 816, 
5 along with a header, to generate the output bit stream 818, The header 820 may contain 
information regarding the size of the frame, the length of the sequence along with the 
type of coding applied in each frame. 

At the receiver end, shown in Figure 9, a reverse procedure may be followed 
using a sequence decoder 900. The first frame, being an I frame 902, is easily 
1 0 reconstructed by performing entropy decoding 904 followed by MEZT decoding 906. 

For the other frames, the ith frame is predicted from the previously reconstructed 
frames ((i-l)th) 920 and the transmitted motion vectors 922. In case of the P frame, the 
error frame 912 is added to the predicted frame 914 to complete the reconstruction 
process. The S frame is the motion vector without the error frame. Finally, inverse DWT 
15 (IDWT) 916 is applied to each of the frames to get the reconstructed sequence. 

In one embodiment, the first block 828 of the codec 800 does the DWT operation, 
as shown in Figure 8. DWT results in decomposition of each of the input frames into a 
multi-resolution subband structure. Unlike the discrete cosine transform (DCT), discrete 
wavelet transformed images contain a lower resolution version of the original image that 
20 is usually called the low- frequency subband. Parameters such as the filter coefficients, 
the number of decomposition levels, etc. can be chosen depending upon the image 
sequence and its intended application. Moreover, for two-dimensional DWT, filtering is 
actually applied separately along each dimension, which makes it parallelly realizable 
and hence suitable for real time applications. 
25 In case of still image compression (i.e., the I frames where no prediction is 

applied), the matrix obtained after DWT is coded using MEZT scheme as indicated at 
block 826. This is an efficient bit-plane wise embedded zerotree coding scheme. 

Since DWT is a multi-resolution transform, which generates a subband hierarchy, 
it is quite natural to use MRME to exploit this property. The resulting multi-resolution 
30 subband structure ensures a strong correlation between the motion activities of subbands 
at different positions and levels. Further, the blocking artifacts generated due to the 
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simple transitory motion model are partially smoothened by the low pass filtering during 
inverse DWT. 

Wavelet transform decomposes a video frame into a set of sub-frames with 
different resolutions corresponding to different frequency bands. These multi-resolution 
5 frames provide a representation of the global motion vectors of the video sequence at 
different scales. 

Although the motion activities for each sub-frame are not all identical, at the same 
time they are highly correlated and hence can be used as an excellent first approximation. 
In the MRME approach, motion vectors for higher resolution are derived from those of 

10 the lower resolution motion vectors. A variable block size approach is taken, in one 

embodiment, which not only reduces the search space and hence the computational time 
but also provides a meaningful characterization of the intrinsic motion structure 
(following the structure of the wavelet transformed sub-frames). 

In one embodiment, the motion estimation 804 may be carried out using a three 

15 step search algorithm. But in principle, any other motion estimation technique may be 
suitable for applying in multiresolution hierarchical DWT subbands. The subsampled 
image (low- frequency subband) is first broken into blocks. Then for each block of a 
current frame (the frame for which motion estimation is being carried out) a matching 
block from a previous frame is identified using a distance criterion. The distance 

20 criterion may be a minimum mean square error, minimum mean of pixel by pixel 
absolute differences, or maximum matching pixel count as a few examples. Sum of 
Pixels by Pixel Absolute Difference (SAD) may be used as the distance criterion for 
choosing the best match. The frame is reconstructed at the transmitter end from the 
previous frame and the motion vectors for purposes of comparison. 

25 In a three step search, SAD is calculated, at the center and at eight specific points 

within search window in the first step. The distances of these positions are four pixels 
away from center of the block of interest. The positions are the eight neighbors of a 
pixel. Depending upon the values of SAD at each search position, the next step search is 
carried out. At the next step, the search positions are along the same directions but 

30 around the position where minimum SAD was found at the previous step and the distance 
is reduced to two pixels instead of four pixels. The minimum SAD position is found in 
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this step. The last step search is carried out around this position and now the distance is 
only one pixel. Here the window size becomes seven pixels (4+2+1) along the x or y 
direction. So the search window is 15 X 15 pixels. 

In the case of a full search algorithm, the number of search positions would have 
5 been 1 5 X 1 5 = 225 . But now the total number of search positions has been reduced to 
only 3 X 8 +1 = 25 resulting in a speed increase by a factor of nine times. 

As the multi-resolution motion estimation approach may drastically reduce the 
computation time, more computationally involved (but better) search strategies may be 
used. In the extreme case, a full search may be used. Here, a search window is located 
1 0 around the current block and SAD is calculated for all positions within that search 
window. A full search may be performed as the search space is small and a better 
estimate of the block motions results in less prediction error, thus reducing the bit budget. 

hi one embodiment, the block LL may be transmitted as it is. However, motion 
estimation or compensation may also be implemented on this block, as it is the same 
1 5 image at a lower resolution. For the block HL motion prediction may be performed. The 
block size taken was 8*8 and the search area was restricted to a small value in this 
example. For the LH block the motion estimation may be done over a reduced search 
area by using the motion vectors calculated for the corresponding blocks in the HL 
subblock as an initial guess. For the HH block no motion prediction may be done, since a 
20 visual system is less sensitive to changes along the diagonal direction. 

For decoding, the block LL may be stored without any modification in one 
embodiment. For the blocks HL and LH the values are reconstructed using the associated 
motion vectors and the previous frame. For the block HH, the average of the motion 
vectors for the corresponding HL and LH positions may be used to reconstruct from the 
25 previous frame. 

The REZT 810 may significantly improve the efficiency of the codec 800 because 
it may generate a very highly compressed bit-stream for the error frame in DWT domain. 
The block 810 may result in a significant reduction in computational complexity by 
drastically reducing the number of scans necessary for coding the error frame 
30 coefficients. 
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The arithmetic coding 8 1 2 performs the task of entropy coding of the symbol 
stream generated by the REZT 810 for the error frames. A variety of arithmetic coding 
schemes may be used for entropy encoding. 

The DWT-based video codec 800 may be computationally efficient because of 
5 reduced computational requirements in the multi-resolution motion estimation and bit- 
plane wise embedded zerotree coding schemes both for DWT frames and the error frames 
after motion estimation and compensation. The encoding scheme may work in one as 
opposed to two passes. This makes the codec 800 suitable for implementation both in 
software and hardware. 

10 The REZT embedded coding scheme is suitable for error images or frames. The 

error image can be generated by taking difference of two successive DWT images in an 
image sequence. In the context of video, the error frame is the difference of the original 
frame from the reconstructed previous frame in the DWT domain. Motion prediction 
followed by motion compensation leads to generation of reconstructed frames. In error 

1 5 frames, the efficiency is increased by applying the embedded coding in HL, LH, and HH 
subbands only as shown in Figure 10. The LL subband can be transmitted without any 
change. The embedded coding may be performed in every bit-plane in one embodiment. 

Before describing the encoding and decoding algorithm, a set of symbols (all the 
definitions are with respect to a certain threshold T 0 and for the nth pass of encoding or 

20 decoding) is defined as follows: 

POS: If the nth bit of a coefficient is 1 and the coefficient is positive, then 

the nth bit is coded as POS. 

NEG: If the nth bit of a coefficient is 1 and the coefficient is negative, 

then the nth bit is coded as NEG. 
25 ABS_ROOT: If the coefficient as well as all its children have magnitude 

less than all the thresholds greater than or equal to TO, then the nth bit is coded as 
ABS_ROOT. 

ROOT: If the nth bit of a coefficient as well as that of all its children are 
0; and if the magnitude of the coefficient is not less than all the thresholds greater 
30 than T 0 , then the nth bit is coded as ROOT. 
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ROOT_IZ: If the nth bit of a coefficient as well as that of all its children 
are 0; and if the magnitude of the coefficient is less than all the thresholds greater 
than T 0 , but the magnitude of all its children are not less than all the thresholds 
greater than To, then the nth bit is coded as ROOT_IZ. 
5 ABSJZ: If the nth bit of a coefficient is 0 but that of all its children are 

not 0; and if the magnitude of the coefficient is less than all the thresholds greater 
than To, then the nth bit is coded as ABSJK. 

IZ: If the nth bit of a coefficient is 0 and that of all its children are not 0; 
and if the magnitude of the coefficient is not less than all the thresholds greater 
10 than To, then the nth bit is coded as IZ. 

The encoding algorithm 1 100 for the nth bit of a coefficient (c) in the error frame 

th 

with respect to a threshold T 0 , shown in Figure 11, begins by determining whether the n 
bit is equal to zero, at diamond 1 102. If not, a check at diamond 1 104 determines 
whether the coefficient is less than zero. If so, the bit is labeled negative and if not, the 
15 bit is labeled positive. 

If the n th bit is equal is zero as determined at diamond 1 102, a check at diamond 
1 106 determines whether n th bit of the coefficient forms a zerotree. If not, a check at 
diamond 1 108 determines whether or not the absolute value of the coefficient is greater 
than the threshold T 0 . If so, the bit is labeled an isolated zero and if not it is labeled an 
20 absolute isolated zero. 

If the n th bit of the coefficient forms a zerotree as determined at diamond 1106, a 
check at diamond 1110 determines whether the absolute value of the coefficient is less 
than T 0 . If not, the bit is labeled a root. If so, a check at diamond 1112 determines 
whether the magnitudes of all the descendants of the coefficient are less than T 0 . If so, 
25 the bit is labeled an absolute root and if not it is labeled a root isolated zero. 

The error matrices (or frames) are discrete wavelet transformed (DWT) and the 
resultant subbands are of the form as shown in Figure 12. The labels (1,2,3) indicate the 
level number of the subbands. 

The starting threshold is taken as 1 in one example. In each successive pass the 
30 threshold is doubled. The total number of such pass is |_log 2 (max)J+l , where max 



17 



denotes the maximum value among the magnitudes of all the coefficients to be encoded. 
The scanning pattern for the coefficients is shown in Figure 12. 

The parent-child relation for the DWT coded frames is shown in Figure 13. The 
four pixels at level 2 are the children of the pixel marked in level 1. The sixteen pixels at 
level 3 are also the descendants of marked pixel in the 1st level. 

In each pass, whenever a coefficient is coded as ABS JROOT, ABS_IZ or 
ROOT_JZ, the corresponding positions are suitably marked against further scanning. 
However, for ABS JZ or ROOTJZ, the marks are valid only for the ongoing pass. 

The following hypothetical example is given to aid in understanding of the coding 
scheme: 



Subband #1 Subband #2 





001 001 
000 010 


100 001 000 000 
001 000 100 011 

000 010 000 001 
000 000 001 000 











In this example, only a part of the error matrix is shown. Encoding of the rest of the 
matrix follows the same algorithm and hence its coding/decoding has not been shown in 
details. The numbers shown are in the binary representation. For convenience of 
representation, the seven symbols explained before are coded using the following 
abbreviations: 

POS:P NEG: N ROOT: R ABS_ROOT: r 

ROOT_IZ:~ IZ: I ABSJZ: i 

For encoding of this matrix, the number of passes required is given by 
log 2 (max)+l . In the above example max = 4(1 00) and so the total number of passes = 3, 
i.e. pass_index varies from 1 to 3= 

For passjndex =1, T 0 (threshold) = 1. 
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The symbols generated for subband #1 for the least significant bits are P, P, ~, I. 
The first and second coefficients (row-wise) are "1" so they are positive and are labeled 
"P". The first coefficient in the next row is root isolated zero as indicated by the fact that 
all of the children (in the lower left quadrant of subband #2) are zero. Then none of the 
children need to be encoded and they are so marked (as indicated below by the 
underline). This analysis may be done as part of a single pass. 

The marked-matrix after this stage with underlining being used to indicate bits 
that are not to be traversed/coded for the ongoing pass and an overline being used to 
indicate bits that are not to be traversed/coded for the remaining part of the encoding: 



001 
000 


001 
010 


100 
001 


001 
000 


000 
100 


000 
011 






000 


010 


000 


001 






000 


000 


001 


000 



The symbols generated for subband #2 are R, P, r, r, P, r, R, P, r, P, P, r. The 
underlined least significant bits above were marked and therefore those bits are not 
coded. 

The marked-matrix after this stage is as follows: 















001 


001 


100 


001 


000 


000 


000 


010 


001 


boo 


100 


011 






000 


010 


000 


001 






000 


000 


001 


000 



After an end of pass adjustment, the marked-matrix becomes: 



001 


001 


100 


001 


000 


000 


000 


010 


001 


boo 


100 


011 






000 


010 


bob 


001 






000 


000 


001 


bob 
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For pass_index=2, T 0 (threshold)= 1*2=2; 

The symbols generated for subband #1 are ~, i, P. The marked-matrix after this 
stage is then: 



001 


001 


100 


001 


000 


000 


000 


010 


001 


boo 


100 


011 






000 


010 


000 


001 






000 


000 


001 


boo 



The symbols generated for subband #2 are R, P, r, P, r, r, r, r. The marked-matrix 
after this stage is: 



001 001 


100 


001 


000 


000 


bbo olo 


001 


bob 


lbo 


Oil 




bob 


oio 


bbo 


bbi 




bbo 


bob 


001 


bob 


djustment, marked-matrix becomes: 


001 001 


100 


001 


000 


000 


000 010 


001 


000 


100 


on 




bob 


oio 


bob 


bbi 




bob 


bbo 


bbl 


bbo 



For pass_index=3, T 0 (threshold)= 2*2=4. The symbol generated for subband #1 
is r. The marked-matrix after this stage is: 



001 


001 


100 


001 


000 


000 


000 


010 


001 


000 


100 


on 






bob 


oio 


bbo 


boi 






bbo 


bob 


bbi 


bob 
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The symbols generated for subband #2: P, r, r, P, r, r. The marked-matrix after 
this stage becomes: 



001 


001 


100 


Oil 


000 


000 


000 


010 


001 


boo 


100 


oil 






000 


010 


boo 


obi 






000 


000 


001 


boo 



5 At the end of the last third pass, there is no need for end of pass adjustment as 

there are no further passes. Hence the coding is complete and the generated symbols are 
P, P, ~, I, R, P, r, r, P, r, R, P, r, P, P, r, ~, I, P, R, P, r, P, r, r, r, r, r, P, r, r, P, r, r. 

This stream of symbols can subsequently be encoded using an entropy encoding 
scheme such as Huffman Coding, Arithmetic Coding (AC), etc. This stream of symbols 
1 0 may be preceded by a header block, which indicates the maximum number of passes (3 in 
this case) along with the dimension of the coded matrix. 

From the header the following information may be available: maximum number 
of passes, dimension of the matrix. For the nth pass, the nth bits of the coefficients are 
being decoded. 

1 5 For pass_index =1, after subband#l decoding of the codes P, P, ~, I, the decoded 

matrix looks like: 




The first and second coefficients (1 and 1) are derived from the first and second codes P. 
20 The code ~ indicates that all the bits are zeros and the bits of the children are zero. Thus, 
the values are completed as indicated above in subband#l and subband#2. After 
subband#2 decoding of the codes R, P, r, r, P, r, r, r, r, the decoded matrix looks like: 
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1 


1 


0 1 


000 000 


000 


0 


1 000 


0 1 






6 o 


000 1 






0 0 


1 000 



In subband#2, the first coefficient is zero based on the code R, the second 
coefficient is one based on the code P, the next two coefficients are all zeros based on the 
two codes r. 

5 For pass_index=2, after subband#l decoding, the decoded matrix looks like: 



001 


01 


00 


01 


000 


000 


000 


10 


01 


000 


0 


1 






0 


0 


000 


1 






0 


0 


1 


000 



After subband#2 decoding, the decoded matrix looks like: 



001 
000 


001 
10 


00 
01 


01 
000 


000 000 
00 11 




boo 

000 


lb 
bob 


000 001 

001 000 
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For pass_index=3, after subband#l decoding, the decoded matrix looks like: 















001 


001 


00 


01 


000 


000 


bob 


bib 


01 


000 


00 


n 






bob 


lb 


000 


001 






bob 


bob 


001 


000 



After subband#2 decoding, the decoded matrix is as follows: 

15 
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001 


001 


100 


001 


000 000 


000 


010 


UUi 


nnn 


mo nn 






000 


010 


000 001 






000 


000 


001 000 



This scheme may perform satisfactorily in case of error frames both for still 
imaging and video coding. In cases when the compression ratio is of more importance 
compared to PSNR, then pass_numbers (1,2,..) Gan be progressively dropped resulting in 
5 a significant increase in compression ratio(but incurring a loss in PSNR). If pass-levels 
are dropped progressively then the CR-performance of REZT improves at a better rate 
compared to that of MEZT. 

The scheme may be computationally faster than the classical EZT technique. 
This scheme successfully avoids passing over the smaller or insignificant coefficients in 

10 every pass by encoding them in course of the initial passes. Further, the two passes of the 
classical scheme has been clubbed into a single pass. 

Further compression can be achieved when the initial passes(l,2 v .) are dropped 
progressively. The decoding scheme remains same as stated earlier with a minor 
modification: suitable number of zeros (depending on the number of passes dropped) are 

15 to be appended to the decoded data. However, such a process results in PSNR loss. 

Other embodiments are within the scope of the following claims. For example, 
the matrices of decomposed coefficients described above have one coefficient in each 
subband of the highest decomposition level. However, this arrangement is for purposes 
of simplifying the discussion of the coding. Therefore, each subband of the highest 

20 decomposition level may have multiple coefficients, and the above-described techniques 
may be applied to code the bits associated with these coefficients. In some embodiments, 
the processor 1 12 may code all of the bits of each order in parallel. In this manner, the 
coding of the bits of each bit order may be performed by the processor's execution of a 
separate thread. Other arrangements are possible. 

25 While the present invention has been described with respect to a limited number 

of embodiments, those skilled in the art will appreciate numerous modifications and 
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variations therefrom. It is intended that the appended claims cover all such modifications 
and variations as fall within the true spirit and scope of this present invention. 
What is claimed is: 
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1 1 . A method comprising: 

2 providing error data that indicate motion in an image; 

3 representing error data as a collection of ordered bits; and 

4 coding the bits of each order to indicate zerotree roots that are associated 

5 with the order. 

1 2. The method of claim 1, wherein the act of coding the bits comprises: 

2 determining which of the bits indicate zeros; and 

3 classifying each zero as either an isolated zero or a zerotree root. 

1 3 . The method of claim 2, wherein some of the error data are descendants of 

2 some of the other error data, and wherein the act of determining comprises: 

3 traversing a descendant tree from a bit associated with one of said some of 

4 the error data to bits associated with said other error data to locate the zerotree roots. 

1 4. The method of claim 1 wherein providing error data includes taking the 

2 difference between two successive image representations in an image sequence. 

1 5 . The method of claim 4 wherein taking the difference includes taking the 

2 difference of two successive discrete wavelet transform coded frames. 

1 6. The method of claim 1 including coding said bits based on whether or not 

2 the data exceeds a predetermined threshold value. 

1 7. An article comprising a storage medium readable by a processor-based 

2 system, the storage medium storing instructions to enable a processor to: 
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3 provide error data that indicate motion in an image, 

4 represent error data as a collection of ordered bits, and 

5 code the bits of each order to indicate zerotree roots that are associated 

6 with the order. 

1 8. The article of claim 7, the storage medium comprising instructions to 

2 enable the processor to : 

3 determine which of the bits indicate zeros, and 

4 classify each zero as either an isolated zero or a zerotree root. 

1 9. The article of claim 8 wherein some of the error signals are descendants of 

2 some of the other error signals, the storage medium comprising instructions to enable the 

3 processor to: 

4 traverse a descendant tree from a bit associated with one of said some of 

5 the error data to bits associated with said other error data to locate the zerotree roots. 

1 10. The article of claim 7 wherein the storage medium comprising instructions 

2 to enable the processor to provide error data by taking the difference between the 

3 successive image representations in an image sequence. 

1 11. The article of claim 10, the storage medium comprising instructions to 

2 enable the processor to take the difference of two successive discrete wavelet transform 

3 coded frames. 
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12. The article of claim 7, the storage medium comprising instructions to 
enable the processor to code the bits based on whether or not the data exceeds a 
predetermined threshold. 



1 1 3 . A system comprising: 

2 a device to generate error frames by differencing two successive frames 

3 and to represent the error frames as a collection of ordered bits; and 

4 an element to code the bits of each order to indicate zerotree roots that are 

5 associated with the order. 



1 14. The system of claim 13 wherein said device includes a processor and a 

2 storage medium storing instructions to enable the processor to provide error data that 

3 indicate motion in the image, represent the error data as a collection of ordered bits, and 

4 encode the bits of each order to indicate zerotree roots that are associated with the order. 

1 15. The system of claim 13 wherein said device codes said bits based on 

2 whether or not the data exceeds a predetermined threshold value. 
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ENCODING OF WAVELET TRANSFORMED ERROR DATA 



Abstract of the Disclosure 
A computer system includes a memory and a processor. The memory stores a 
program to cause the processor to provide error data that indicate motion in an image. 
The processor represent each error signal as a collection of ordered bits, and the 
processor codes the bits of each order to indicate zerotree roots that are associated with 
the order. 
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Attorneys Docket No.: iNTL-0210~P1-US (P7057X) PATENT 

DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 
As a below named inventor, I hereby declare that; 

My residence, post office address and citizenship are as stated below, next to my name. 

I believe I am the original, first, and sole inventor (if only one name is listed below) or an 
original, first, and joint inventor (if plural names are listed below) of the subject matter 
which is claimed and for which a patent is sought on the invention entitled 

ENCODING OF WAVELET TRANSFORMED ERROR DATA 
the specification of which 



is attached hereto. 

was filed on as 

United States Application Number 



or PCT International Application Number 
and was amended on 



(if applicable) 



I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claim(s), as amended by any amendment referred to above. I 
do not know and do not believe that the claimed invention was ever known or used in the 
United States of America before my invention thereof, or patented or described in any 
printed publication in any country before my invention thereof or more than one year prior 
to this application, that the same was not in public use or on sale in the United States of 
America more than one year prior to this application, and that the invention has not been 
patented or made the subject of an inventors certificate issued before the date of this 
application in any country foreign to the United States of America on an application filed by 
me or my legal representatives or assigns more than twelve months (for a utility patent 
application) or six months (for a design patent application) prior to this application, 

I acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal Regulations, Section 1 .56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 119(a)- 
(d), of any foreign application^) for patent or inventor's certificate listed below and have 
also identified below any foreign application for patent or inventor's certificate having a 
filing date before that of the application on which priority is claimed; 

Prior Foreign Application^); Priority Claimed 



Number ~ (Country) (Day/Month/Year Filed) Yes No 



Number (Country) (Day/Montfi/Year Filed) Yes No 



Number (Country) (Day/Morrth/Year Filed) Yes No 
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I hereby claim the benefit under title 35, United States Code, Section 119(e) of the United 
States provisional application(s) listed below: 



(Application Number) 



(Filing Date) 



(Application Number) 



(Filing Date) 



I hereby claim the benefit under Title 35, United States Code, Section 120 of any United 
States application(s) listed below and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the manner 
provided by the first paragraph of Title 35, United States Code, Section 112, I 
acknowledge the duty to disclose all information known to me to be materia! to 
patentability as defined in Title 37, Code of Federal regulations, Section 1.56 which 
became available between the filing date of the prior application and the national or PCT 
International filing date of this application; 

09/390,255 09/03/99 Pending 

(Application Number) Filing Date (Status-patented, pending, abandoned) 

' (Application Number) ~" Filing Date ~ (Status-patented, pending, abandoned) 

I hereby appoint Timothy N. Trap, Reg. No. 28,994; Fred G. Pruner, Jr., Reg. No. 40,779 
and Dan C. Hu, Reg. No. 40,025, Ruben S. Bains, Reg. No. 46,532, my patent attorneys, 
of TROP, PRUNER & HU, P.C M with offices located at 8554 Katy Freeway, Ste. 100, 
Houston, TX 77024, telephone (713) 468-8880, andMirho, Charles A.; Registration No. 
41,199; Novakoski, Leo V,; Registration No. 37,198; Reynolds, Thomas C; Registration 
No. 32,488; Seddon, Kenneth M.; Registration No. 43,105; Seeley, Mark; Registration 
No. 32,299; Skabrat, Steven P.; Registration No, 36,279; Skaist, Howard A,; Registration 
No. 36,008; Su, Gene I.; Registration No. 45,140; Wells, Calvin E.; Registration No. 
43,256; Werner, Raymond J.; Registration No. 34,752; Winkle, Robert G,; Registration 
No- 37,474; and Young, Charles K.; Registration No. 39,435 my patent attorneys, of 
INTEL CORPORA-TION with full power of substitution and revocation, to prosecute this 
application and to transact all business in the Patent and Trademark Office connected 
herewith. 

Send correspondence to Timothy N. Trop , TROP, PRUNER & HU, P.C., 8554 KATY 
FWY, STE 100, HOUSTON, TX 77024-1805 and direct telephone calls to 
Timothy N, Trop, (713) 468-8880. 

i hereby declare that all statements made herein of my own knowledge are true and that 
alt statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of 
the United States Code and that such willful false statements may jeopardize the validity of 
the application or any patent issued thereon. 
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Full Name of Sole/First Inventor; 
TINKU ACHARYA 


Inventor's Signature: 


Date: 


Residence; 

7292 W. ERIE ST„ CHANDLER ARIZONA 85226 


Citizenship: 
INDIA 


Post Office Address: 

7292 W. ERIE ST., CHANDLER, ARIZONA 85226 


Full Name of Second/Joint Inventor; 
PRABIR K. BISWAS 


Inventor's Signature: 


Date: 


Residence: 

CALCUTTA, INDIA 


Citizenship: 
INDIA 


Post Office Address: 

DEPARTMENT OF ELECTRONICS AND ELECTRICAL COMMUNICATION ENGINEERING, 
INDIAN INSTITUTE OF TECHNOLOGY, KHARAGPUR - 721302, INDIA 


Full Name of Third/Joint Inventor: 
NILOYJ. MITRA 


Inventors Signature; 


Date: 


Residence: 

CALCUTTA, INDIA 


Citizenship: 
INDIA 


Post Office Address; 

DEPARTMENT OF ELECTRONICS AND ELECTRICAL COMMUNICATION ENGINEERING, 
INDIAN INSTITUTE OF TECHNOLOGY, KHARAGPUR - 721302, INDIA 



INTL-0210-P1-US (P7057X) 
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Attome/s Docket No.: 1NTL-0210-P1-US (P7057X) PATENT 

DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 
As a below named inventor, I hereby declare that; 

My residence, post office address and citizenship are as stated below, next to my name. 

I believe I am the original, first, and sole inventor (if only one name is listed below) or an 
original, first, and joint inventor (if plural names are listed below) of the subject matter 
which is darned and for which a patent is sought on the invention entitled 

ENCODING OF WAVELET TRANSFORMED ERROR DATA 
the specification of which 



is attached hereto. 

was filed on as 

United States Application Number 



or PCT International Application Number 
and was amended on 



(if applicable) 



I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claim(s), as amended by any amendment referred to above. I 
do not know and do not believe that the claimed invention was ever known or used in the 
United States of America before my invention thereof, or patented or described in any 
printed publication in any country before my invention thereof or more than one year prior 
to this application, that the same was not in public use or on sale in the United States of 
America more than one year prior to this application, and that the invention has not been 
patented or made the subject of an inventor's certificate Issued before the date of this 
application in any country foreign to the United States of America on an application filed by 
me or my legal representatives or assigns more than twelve months (for a utility patent 
application) or six months (for a design patent application) prior to this application. 

I acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal Regulations, Section 1 .56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 119(a)- 
(d), of any foreign application(s) for patent or inventor's certificate listed below and have 
also identified below any foreign application for patent or inventor's certificate having a 
filing date before that of the application on which priority is claimed; 

Prior Foreign Application^): Priority Claimed — 

Number (Country) (Day/Month/Ytar Red) "Vis "Nto 

Number (Country) (Day/Month/Year Filed) Yes Wo 



Number 



(Country) (Day/Month/Year Filed) Yes No 
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I hereby claim the benefit under title 35, United States Code, Section 1 19(e) of the United 
States provisional application(s) feted below: 



(Application Number) (Filing Date) 

(Application Number) " (Filing Date) 

I hereby claim the benefit under Title 35, United States Code, Section 120 of any United 
States applications) listed below and* insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the manner 
provided by the first paragraph of Title 35, United States Code, Section 112, I 
acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal regulations, Section 156 which 
became available between the filing date of the prior application and the national or PCT 
International filing date of this application: 

09/390,255 09/03/99 Pending 

(Application Number) Filing Date (Status-patented, pending, abandoned) 



(Application Number) Filing Date (Status-patented, pending, abandoned) 

I hereby appoint Timothy N. Trap, Reg. No. 28,99*; Fred G. Pruner, Jr., Reg. No. 40,779 
and Dan C. Hu, Reg. No. 40,025, Ruben S* Bains, Reg. No. 46,532, my patent attorneys, 
of TROP, PRUNER & HU P,C., with offices located at 8554 Katy Freeway, Ste. 100, 
Houston, TX 77024, telephone (713) 468-8880, and Mirho, Charles A,; Registration No. 
41,199; Novakoski, Leo V.; Registration No. 37,198; Reynolds, Thomas C; Registration 
No. 32,488; Seddon, Kenneth M.; Registration No. 43,105; Seeley, Mark; Registration 
No. 32,299; Skabrat, Steven P.; Registration No. 38,279; Skaist, Howard A.; Registration 
No. 36,008; Su, Gene L; Registration No. 45,140; Wells, Calvin E.; Registration No. 
43,256; Werner, Raymond J.; Registration No. 34,752; Winkle, Robert G.; Registration 
No. 37,474; and Young, Charles K.; Registration No. 39,435 my patent attorneys, of 
INTEL CORPORA-TJON with full power of substitution and revocation, to prosecute this 
application and to transact all business in the Patent and Trademark Office connected 
herewith. 

Send correspondence to Timothy N. Trop , TROP, PRUNER & HU, P,C„ 8554 KATY 
FWY, STE 100, HOUSTON, TX 77024-1805 and direct telephone calls to 
Timothy N. Trop, (713) 468^8880. 

I hereby declare that all statements made herein of my own knowledge are true and that 
ali statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of 
the United States Code and that such wilful false statements may jeopardize the validity of 
the application or any patent issued thereon. 
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Full Nafoe of Soie/Ftr&t Inventor 
TINKU ACHARYA 



invcnto '$ Signature; 



Residence; 



7292 W. ERIE ST., CHANDLER ARIZONA 85226 



Date: 



Citizenship: 

INDIA 



Post Office Address: 

7292 W.ERIE ST„ CHANDLER, ARIZONA 8 5226 

Full Name of Second/Joint Inventor; 
PRAE IR K. BISWAS 



Inventor's Signature; 




Reside ice: 

khaf:agpur, india 



D$tt>: 



CitizHnsWp; 
INDIA 



Post Oi fice Addrsss* _l 
DEPARTMENT OF ELECTRONICS AND ELECTRICAL COMMUNICATION ENGINEERING, 
INDIAN INSTITUTE OF TECHNOLOGY, KHAR AGPUR - 721302, INDIA 

Full Na tin of Tlihcl/Joinl Inventor. 

NILOY J. MITRA 

Invenlu's Slynatuie: 



Rcsidf \ ice: 

CALC UTTA, INDIA 



Date: 



CitizensNp: 
INDIA 



Post 0 ftcc Address* 

DEPARTMENT OF ELECTRONICS AND ELECTRICAL COMMUNICATION ENGINEERING, 
INDIAN INSTITUTE OF TECHNOLOGY, KHARAGPUR - 721302, INDIA _ 
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Attorney's Docket No.: ]NTL-021Q-Pi-U3 (?7Q57X^ LATENT 

DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 
As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below, next to my name. 

( believe i am the original, first, and sole inventor (if only one name is listed below) or an 
original, first, and joint inventor (if plural names are listed below) of the subject matter 
which is claimed and for which a patent is sought on the invention entitled 

ENCODING OF WAVELET TRANSFORMED ERROR DATA 
the specification of which 



is attached hereto, 
was filed on 



as 



United States Application Number 

or PCT International Application Number 
and was amended on 



(if applicable) 



I hereby state that 1 have reviewed and understand the contents of the above-identified 
specification, including the claim(s) ] as amended by any amendment referred to above, i 
do not know and do not believe that the claimed invention was ever known or used in the 
United States of America before my invention thereof, or patented or described in any 
printed publication in any country before my invention thereof or more than one year prior 
to this application, that the same was not in public use or on sale in the United States of 
America more than one year prior to this application, and that the invention has not been 
patented or made the subject of an inventor's certificate Issued before the date of this 
application in any country foreign to the United States of America on an application filed by 
me or my legal representatives or assigns more than twelve months (for a utility patent 
application) or six months (for a design patent application) prior to this application. 

I acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal Regulations, Section 1.58. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 119(a)- 
(d) t of any foreign application(s) for patent or inventor's certificate listed below and have 
also identified below any foreign application for patent or inventor's certificate having a 
filing date before that of the application on which priority is claimed; 



Prior Foreign Appiication(s): 



Priority Claimed 



Number 


(Country) 


(Day/Month/Year Filed) 


Yes 


No 


Number 


(Country) 


{Day/Month/Year Filed) 


Yes 


No 


Number 


(Country) 


(Day/Month/Year Filed) 


Yes 


No 
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1 hereby claim the benefit under title 35, United States Code, Section 119(e) of the United 
States provisional appiication(s) listed below; 



(Application Number) (Filing Date) 



(Application Number) (Filing Date) 

I hereby claim the benefit under Title 35, United States Code, Section 120 of any United 
States appiication(s) listed below and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the manner 
provided by the first paragraph of Title 35, United States Code, Section 112, I 
acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal regulations, Section 1.56 which 
became available between the filing date of the prior application and the national or PCT 
international filing date of this application: 

09/390,255 09/03/99 Pending 

(Application Number) Filing Date (Status-patented, pending, abandoned) 



(Application Number) Filing Date (Status-patented, pending, abandoned) 

I hereby appoint Timothy N. Trop, Reg, No. 28,994; Fred G. Pruner, Jr., Reg. No. 40,779 
and Dan C. Hu, Reg, No. 40,025, Ruben S. Bains, Reg. No. 46 t 532, my patent attorneys, 
of TROP, PRUNER & HU, P.C., with offices located at 8554 Katy Freeway, Ste. 100, 
Houston, TX 77024, telephone (713) 468-8880, and Mirho, Charles A.; Registration No. 
41.199; Novakoski, Leo V.; Registration No. 37,198; Reynolds, Thomas C; Registration 
No. 32,488; Seddon, Kenneth M.; Registration No. 43,105; Seeley, Mark; Registration 
No. 32,299; Skabrat, Steven P.; Registration No, 38,279; Skaist, Howard A.; Registration 
No- 36,008; Su, Gene L; Registration No. 45,140; Wells, Calvin E.; Registration No. 
43,256; Werner, Raymond J.; Registration No. 34,752; Winkle, Robert G.; Registration 
No. 37,474; and Young, Charles K.; Registration No, 39,435 my patent attorneys, of 
INTEL CORPORA-TION with full power of substitution and revocation, to prosecute this 
application and to transact alt business in the Patent and Trademark Office connected 
herewith. 

Send correspondence to Timothy N. Trop . TROP, PRUNER & HU, P.C., 8554 KATY 
FWY, STE 100, HOUSTON, TX 77024-1805 and direct telephone calls to 
Timothy N. Troa (713) 468-8880. 

i hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of 
the United States Code and that such willful false statements may jeopardize the validity of 
the application or any patent issued thereon. 
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Full Name of Sole/First Inventor: 
T1NKU ACHARYA 




Inventor's Signature: 


Date: 




Residence* 

7292 W. ERIE ST., CHANDLER ARIZONA 85226 


Citizenship: 
INDIA 




Post Office Address: 

7292 W. ERIE ST., CHANDLER, ARIZONA 85226 




Full Name of Second/Joint Inventor 
PRABIR K. BISWAS 




Inventor's Signature: 


Date: 




Residence: 

CALCUTTA, INDIA 


Citizenship: 
INDIA 


G 


Post Office Address: _ . r . fcl - ltl - 1 -„ lfcl ^ 
DEPARTMENT OF ELECTRONICS AND ELECTRICAL COMMUNICATION ENGINEERING, 

INDIAN INSTITUTE OF TECHNOLOGY, KHARAGPUR - 721302, INDIA 




Full Name of Third/Joint inventor 
NILOY J. MITRA 


{*£ 


inventor's Signature: 


Date: 




A/cy 4(fCv tMr& 






Residence, 

CALCUTTA, INDIA 


Citizenship: 
INDIA 




DEfSStoENT OF ELECTRONICS AND ELECTRICAL COMMUNICATION ENGINEERING, 
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